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Abstract 

We discuss and solve a model for a game with many players, where a subset 
of truely deciding players is embedded into a hierarchy of dependent agents. 

These interdependencies modify the game matrix and the Nash equilibria 
for the deciding players. In a concrete example, we recognize the partition 
function of the Ising model and for high dependency we observe a phase tran¬ 
sition to a new Nash equilibrium, which is the Pareto-efficient outcome. 

An example we have in mind is the game theory for major shareholders in 
a stock market, where intermediate companies decide according to a majority 
vote of their owners and compete for the final profit. In our model, these 
interdependency eventually forces cooperation. 
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1 Introduction 

Roughly 20 years ago, an exciting new set of methods has been introduced into 
game theory: An underlying game G, such as the Minority Game, played by a large 
ensemble of players, can be analyzed and often solved using methods from statis¬ 
tical physics. For comprehensive overviews on the development of this subject, see 
[CMZ05] or |Coolen05] . The analysis exhibits critical points where phase transi¬ 
tions appear in the thermodynamic limit of many players and it provides models 
for the emergence of mutual cooperation. The evolution of a large set of agents 
with prescribed strategies or learning mechanisms have been studied as dynamical 
systems e.g. in 1 CZ97 L jCoolen05] 0 r |NM92] . 

In this article, we want to focus on the influence of a large ensemble of agents on 
the game theory of a given game G, including game matrix and Nash equilibria. In 
the model we study, the game G is embedded into a hierarchy of automata/agents, 
that pass decisions by majority votes. The top of the hierarchy remains a set of 
new active/deciding players, which now play a new transformed game F. We then 
wish to understand how the game theory of T compared to G changes, depending 
on the given intermediate hierarchy. This has been solved by the first author as 
part of her diploma thesis [Kraus 11] . 

More specifically, in section 2 we suppose that we are given a weighted directed 
graph T~L and a game G = (A, S , u) played by a subset of the vertices T~Ly of H 
called executive players L C Hy. We define a transformed game T = (A, S, v) with 
new players A C Tty. The graph hereby is imagined as a hierarchy of agents with 
executive players L at the bottom of the hierarchy, while new deciding players A at 
the top of the hierarchy successively control the behaviour of the agents according 
to their influence. Conversely, the payoff of G for all executive players L is finally 
collected by the deciding players according to the natural bargaining process in this 
situation (Shapely value). Other payoff mechanisms are possible and got discussed 
in [ Kraus 11 ] as well. 

The main example for this model we have in mind is the stock market, where the 
deciding players A send instructions through a graph that represents the structure 
of the mutual ownerships of the companies. Finally, some executive companies 
L play a executive game G in “reality”, such as prisoner’s dilemma or minority 
game. So we ask, how the stock market and mutual ownerships of the intermediate 
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agents/companies have altered the game G to T. 


To solve T thermodynamically, we need more than a partition function summing 
over all possible strategies as done e.g. in [CoolenOh] . Rather, the conditional prob¬ 
abilities of one agent’s decision influencing another one have to be calculated. They 
correspond physically to /c-point correlation functions (see definition [SJ and espe¬ 
cially for A = 0 (no deciding players) the overall expression reduces to the partition 
function. 

In section 3, we recognize that for treelike hierarchy graphs our fc-point correlation 
functions coincide with a generalized Ising model on the graph T~L. This enables us 
in principle to write down the game matrix, Nash equilibria and phase transitions 
of the game T for a given game G whenever the Ising model for H is accessible. Of 
particular interest to us is the case where T~L is a random graph, which has been 
solved in |I)CH10| . 

In section 4 we demonstrate the approach and methods developed in this article. 
We solve and thoroughly analyse an example of an executive prisoners dilemma G 
being transformed to a hierarchical game T with again two deciding players, but 
with a certain hierarchy of agents between deciders and executive G-players. 

Especially, we can establish a phase transition in the game T, if the branching factor 
of the tree is sufficiently high (otherwise we get only a tipping point) as the mutual 
influence approaches a critical threshold. The phase transition in T separates a 
phase with the (defecting) Nash equilibrium in G from a phase corresponding to 
the (cooperating) Pareto-efficient outcome. Roughly spoken, if the mutual depen¬ 
dency in decision making gets high, egoistic strategies become unstable and mutual 
cooperation emerges. 

2 Definition Of The Hierarchical Game 

In the following we suppose to be given a weighted directed graph TL, whose vertices 
contain among others executive players L playing a game G. We suppose G to have 
only two moves. The graph should be imagined as a hierarchy with executive players 
L at the bottom of the hierarchy. The key notion of this article is then a transformed 
game T = (A, E, v) with new deciding players A at the top of the hierarchy, who 
successively control the behaviour of the agents and collect the G-payoff according 
to their influence. 
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deciding 
players A: 



instructions for G-moves 


graph 


payoff floating back 


executive 
players L: 


i is' v; ^ 3 

L playing the executive game G 


Definition 1 (Executive Game G ). From now on, let G = (L , {Si}; g L, {uj}i g i,) be 
a game in normal form with players L = {1... n} and each player i £ L having two 
strategies Si = S = {±1}- The overall strategy set is hence S L = X = {±l} n 

i£L 

and we denote the payoff for each player i £ L by Ui : S L —> R. 

We denote by A B the set of all maps between A and B and by RA the vector space 
spanned by the set A. 

Definition 2 (Hierarchy Graph H). Let Ti = (Hy, He, {fvw}vwen E ) be a con¬ 
nected, directed, weighted graph with vertex set Hy and directed edges vw £ He 
with positive weights f vw > 0 for v,w £ Hy . 

We denote the direct predecessors and successors of vertices w, v £ Hy by 

pre(w) = {v £ Hy \ vw £ He} suc(v) = (ru £ Hy \ vw £ He}- 

We further denote by Hq C Hy all vertices without predecessors and without loss 
of generality we assume the predecessor weights to be normed: 

Vw£Hy\H 0 : /™ = 1 

v£pre(w) 

Definition 3. (Hierarchical Game T = HG) Suppose a fixed game G = (L,S,u ) 
and a fixed hierarchy graph H with L C Hy. The transformed hierarchical game 
r = HG := (A, E, v) consists of 

• A set of deciding players A := Ho = {Ai... X m }- 

• A strategy set Ea = E = S L for each deciding player A £ A. Such a strategy 
Emulates a G-strategy-command to each executive player i £ L. The overall 
strategy set is hence E A . 

• A payoff function v\ : E A —> R for each deciding player \ £ A given by 
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The function n : RE B = M (S L ) L —> M.S L is given by restricting a set of G- 

strategy-commands for each executive player (upM £ E L to the strategies 

V / i,j£L 

chosen for the respective player ) £ S L . 

V / ieL 

The functions Pl\k '■ RE A —> RE L and <f>\ : A —> R L depending on the 

hierarchy TL will be defined in what follows: 

— Pb\a '■ RE A —>■ RE b for subsets A,BcT, denotes the conditional influ¬ 
ence of players A on players B and should be read as a (\A\ + \B\)-point- 
function. A deciding player A € A has been defined to have a strategy 

= (a^) ieL GS L =: E 

formulating the aim to have each executive player i using strategy cpp . 
These G-strategy-commands <r = (cr\),\ g A £ E of all deciding players 
A compete along the hierarchy graph and determine an overall outcome 
probability distihbution Pl\k{&) £ RE L as described in the next section. 

— <f>\ : A —>■ describes, how much of the payoff earned by each of the 

executive player i £ L can be finally collected by a deciding player X. 
The condition X^AeA y\ = 1 is needed. In 1 Kraus 1U we have discussed 
different payoff collection mechanisms, but in the following we will re¬ 
strict ourselves to the natural result of a bargaining process between the 
deciding players A determined by the the Shapely value (\OR9fl ). This 
particular choice has moreover the nice property to only depend on the 
conditional influences Pl\\. 

Remark 4. Stock Market 

An easy application of this model is a stock market. The game T = (A, E, v) is 
played by deciding players A (e.g. major stockholders). The graph represents mu¬ 
tual ownerships of companies that pass the instructions of the deciding players via 
m to the executive players: These equations represent a voting in each node, that 
weights the possessions of the direct predecessors (respective direct owners) together 
with a small percentage D, the free float of randomly voting minor stockholders. 
The executive players L play the game G = (L,S,u) according to the instructions 
they get - they act as agents and aren’t players in a game theoretical sense. The 
payoff which the executive players get is returned to the deciding players weighted 
by the Shapely value: The more influence deciding player A has on executive player 
i, the more is A getting ofi’s payoff Ui. 

So we ask how the stock market and mutual ownerships of the intermediate agents/ 
companies have altered the game G to T. Roughly we find that if the mutual depen¬ 
dency in decision making gets high, egoistic strategies become unstable and mutual 
cooperation emerges. 
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2.1 Conditional Influences 

We yet have to explain the function Pl|a : R£ A —> KS L . First consider a neigh¬ 
bourhood graph TL p ^p consisting of a point p with predecessors P. Suppose a yes- 
no- decision process, where Oy'' 1 £ {±1} represents commands of each v £ P to p. 
The process shall be a vote in p, where every predecessor v has votes according to 
the weight f vp and a percentage of D £ ]0,1[ votes randomly ~ jV(0, &%■)■ 

Lemma 5 (Single Vote). For the neighbourhood graph T~Lp,p the probability for a 
result +1 in the point p under some given condition (cri P ^) V £p is 

psjngie ^(p) = +1 | ( cr (p)) ?;gP ^ = 1 - Pjy(0, a%-)(-C) « ^ ^ tanh(-oC') 

at which C = ^ fv P &i P ^ and a = . / ^ . (2) 

veP V m 

Proof. Denote by X^ ~ Af(0,<rJj-) the Gaussian random variable of the random 
voters. 


-psingle 

p\p 



+ 1 1 (*P) veP ) = p;;; 9le (dxm + a -d)J 2 fvpW > o 


vGP 


= P 


,single 


p\P 


A '“ a - ^ E !•**« 


(p) 


V 


c 


= 1 - -FV(0, <j%-)(—C) 


1 

2 


— tanh(— aC) with a = 



For approximation we use the similarity of the normal distribution and the tangens 
hyperbolicus (see [Kraus 11] ). □ 

Provided that H does not contain directed cycles, the entire voting process goes on 
iteratively and we obtain straight-forward by induction for any A C TLq,B C 7L 


Pb\a{o) = 


t\b- n 


r£{±l} K v, t \a— (7 


,single 

p|pre(p) l ' IP 


p(z'Hv\'H o 


7 "lpre(p) 


If H does contain directed cycles then there is no terminating voting process. We 
nevertheless propose in complete analogy to statistical mechanics to assign in such 
a situation the conditional probabilities, which clearly reduce to the previous ex¬ 
pression when no directed cycle is present: 


Pb\a{<?) = 


Z 


B\A 


E 

tE{±1} k v, t\a—ct 


T \B 


n 


p 


single 


p|pre(p) l IP 


p€L'Hv\B o 


'lpre(p) 
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with the following now nontrivial normalization constant called partition function 


m:= e n hi, 

tG{±1}^v , t|a=o' p€'Hv\'Ho 

This expression can be justified by a random experiment as follows: Let the prob- 
ability space be Q := {±l}' hLv with product measure 

r(r)-= n 

pe«v\Ho v 




Take as events ^(ct) C D to be the event that holds t\a = cr and analogously for 
f2s(tj'). Then the conditional probability for Ob(<t') under the condition Qa(&) is 
defined as 


Pb\a — 


P (£Ib(ct') n £U(cr)) 
P(fU(cr)) 


Plugging in the product measure P(r) and taking a formal linear combination over 
the outcome a' = t\b yields the formula above. 


2.2 Payoff Mechanisms 

Once the conditional probabilities Pl|a(ct) € for given strategies a\ of each 
deciding player A £ A have been evaluated, this determines the behaviour of the 
executive players to 

r = (ttoP^a) (a) G 1 S L . 

This strategy produces in the game G a payoff Ui(r) for each executive player i £ L. 
So how is this payoff collected finally by the executive players in A? Denote by (f>^ 
the percentage of payoff of executive player i that is collected by deciding player A, 
the payoff collecting mechanism. Then the overall payoff function of the game T is 



Example 6 (Payoff by shares). The most intuitive payoff collecting mechanism 
for treelike hierarchy graphs is payoff proportional to the amount of shares of the 
executive player i indirectly held by deciding player X: 

J2 Y[ fvw 

paths from A to i vw £ path 

This fulfills = 1 ( see \KrauslVj ). An example for this payoff collecting 

mechanism is the paying of dividends proportional to the amount of stocks held by 
an owner. 

However, in the following we will restrict ourselves to the natural result of a bargai- 
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ning process between the deciding players A according to their influence - the payoff 
is hence determined by the Shapely value jOR941 of the obvious coalition function: 


:2' a I 


K i 


P(sj = 1|4° = 1 VA € K,af = -1 VA #K) - P( a< = l|r^ = -1 VA) 
2 P{ Si = l|r£ } = 1 VA) - 1 


This particular choice for a payoff collection mechanism has moreover the nice pro¬ 
perty to only depend on the conditional influences Pl\a- 

Lemma 7. For the payoff function by Shapely value we get 


E 

KCA,\£K 


(|A-|-1)!(|A|-|A1)! 

|A| 


( z i(K) — Zi(K \ {A})). 


(4) 


Proof. The necessary scaling condition = 1 is fulfilled (see [OR94] l. □ 


3 Hierarchical Games On Trees Are Ising Models 

In the following section we prove that the conditional influence can be calculated 
by using an isomorphic Ising model. For the common definition of the Ising model, 
see for example |Nolting07|. Some first analogies are obvious: 


Ising model 

hierarchical game 

particles in a graph H 

same graph H 

spin of particle v: 
cr v £ {±1} 

strategy of v £ Hy. 
cr v = (o4 1} ... e {±1}” 

interaction J vw 

(with D modified) weights f vw ■ 4^ 

external magnetic field (is set to 0) 

some systematic bias (not treated) 


In addition to that, fc-point-functions are needed for conditional probabilities. 

Definition 8. Let A,B be disjoint subsets of the nodes in the Ising model. Let 
the nodes beyond A, named N(A), be the nodes of Hy \ (dU B), that fulfill the 
following condition: Every path to any v' £ B hits at least one v £ A. With 
nodes beyond B (named N(B)) defined analogously, the nodes between A and B 
are N(A , B) := H v \ (N(A) U N(B)). 

With k = |A| + | B | the fc-point-function is 

(±1} |S| x (±1} |A| —> M 

(a', a) i — ■> (cr' | N(A,B) \ a) 

= ^ ex P(~P H N(A,B)) ( 5 ) 

cr'jCT fixed 

where Hn(A,b) is the Hamiltonian function of the restricted graph just containing 
the nodes N(A,B ) and /3 = is the inverse temperature in the Ising model. 
















Lemma 9. Let <j v £ {±1} be the spin of particle v, a £ (±1}I‘ 4 I the spins of parti¬ 
cles in A and let the external magnetic field be 0. Then the conditional probability 
for a v given a is 


P(a v = 1 | cr) 


(<?v = 1 I N A '{ v y | a) 
EI n a,{v} I cr) 


( 6 ) 


Proof. See |Krausllj . 


□ 


Remark 10. The Ising model without external magnetic field and with constant 
interaction J is exactly solvable in one dimension, see \Nolting07 [ /. In this case, the 
conditional probability for two particles v, v' with spins a, a' and distance a is 


P(a' | a) = 


cosh a (/3J) ± sinh a (/3 J) 
2 cosh a (/3J) 


(7) 


where the case ”+” occurs when <j = a' and if a ^ cr'. This remark will be 
needed for the example in subsection \f.‘h\ 


Theorem 11. Every hierarchical game on a graph (as defined in section 0) that 
fulfills the condition, that Vi £ L the restricted graph of the nodes is a tree, 
is isomorphic to an Ising model such that a process in the game that leads from 
fixed VA 6 A to the strategy = Si of one i £ L is equivalent to a process 
in an Ising model on the same graph with interactions J vw = fvw^jp-, inverse 
temperature (I = and no external magnetic field. 


Isomorphic hereby means that the conditional influence and the /c-point-functions 
coincide. 


Proof. For details, see section 4 in f Krauslll . 

As the graph had to be specified to a tree-like graph, the process fixates the strate¬ 
gies step by step. Therefore is it enough to look at the local fixation of a strategy 
in one node and to compare © and ©. Doing this gives the interactions and the 
inverse temperature as mentioned above. □ 

Remark 12. The restriction to tree-like graphs seems harsh on the first sight. 
However even a one-dimensional model shows interesting behaviour (see subsection 
\4-.Sfy and also the calculation of Ising models on random graphs as done in WGH10( 
typically requires the graph to be at least locally treelike. 


4 Solution Of The Hierarchical Game 

4.1 Steps For The Solution 

Let F = (A, SjZ') be a hierarchical game as defined in section [2] with A = {Ai, A 2 } 
and L = (1, 2}. (The restriction to two players allows the use of payoff matrices.) 

1. Determining the conditional influence 

With two players in each A and L, the conditional influence depends on only 
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four variables obtained from the Ising model and equation ©■ 


conditional influence on 1 : x = Pl\a( s i = 1 

V = Pl\a{si = 1 
conditional influence on 2 : x = Pl\a ( s 2 = 1 

y = Pl\a(s2 = 1 



-1,(7 


( 1 ) 

A 2 


1) 


_(2) 


t ( 2 ) 


= = 

= i.-2 J = 


i) 

-i) 

1 ) 


2. Building up the pre-payofF matrix 

The pre-payoff matrix assigns to every combination of strategies cr = (cr\i, u \ 2 ) 
in £ a the expected payoff iq to executive player i £ L in game G: 


E[(wi, u 2 ) | a] = (ui,U 2 ) ono P L \ K (cr ) 

= 5Z P Oa( s I ct Ai,cta 2 ) • u(s) 
ses 

= EE ?i l A ( Sl I 4?-4?) ' p l\a{s 2 I cr { £,a { £) ■ u(s 1 ,s 2 ) 

Sl S 2 


3. Building up the payoff matrix 

To get the payoff matrix v\ for T as defined in equation © multiply every 
item in the pre-payoff matrix with 


,(!) 


l / 

< y-x 

x+y—1 

Ai 

( P\ 2 


2y-l 

2y-l 


(A (2) 


x-\-y— 1 

y-x 

Ai 

VX2 ) 


^ 2y-l 

to 

1 


4. Usual methods 

Now that there is a payoff matrix for the game, the usual game theoretical 
methods can be applied to find Nash equilibria and phase transitions. 


4.2 Example To Step 1: Easy Hierarchical Graph 


Ai : 





1 : si 



A 

1 1 

i 

T 

1 

i 

T 

1 

i 

T 

1 


i 

T 

1 1 



A2 : <?\ 2 


@ 


2 : s 2 


Figure 1: One-dimensional hierarchical game 




(i) 

A 2 
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In the one-dimensional hierarchical game, the deciding and executive players are 
connected by chains of a, b, c or d edges. Therefore the weights are 1, except down 
at the executive players (weights |). Let d be The conditional influence can 
now be calculated with equation 0 which leads to 


x = Pl\a(s i = 1 


y = Pl\a(si = 1 


(i) = (i) = ,\ = _ M-» a ) • _ 

Al ’ /z(-,a)-/i(+,c) + /i(+,a)-/z(-,c) 

(i) = , (i) _ i \ __ M+,«0 -m(+,c) _ 

Al ’ A2 /■«(+, a) ■ m(+,c) +/x(-,o) • /x(-,c) 


where /x(±, fc) = cosh fc 1 (/3) cosh(^) ± sinh fc 1 (/3)sinh(|). 




Figure 2: Conditional influence x with fixed c (left) and conditional influence y with 
a = c (right) 

As a; is a measure for player 1 obeying rather A 2 than Ai if their instructions differ, 
x is growing if a increases and the influence of Ai therefore decreases as it can be 
seen on the left. However, for small (5 (which means high temperature T) x is close 
to ~ no matter how far the deciding players are from each other. As y shows how 
much player 1 is likely to obey Ai and A 2 if they agree, the right graph shows how 
y is close to 1 if both deciding players are near to 1 at a low temperature. If the 
distance and the temperature increase, 1 tends to choose its strategy randomly with 
probability 7 ). 

4.3 Example To Step 2-4: Prisoner’s Dilemma 

Let the game G be the well-known prisoner’s dilemma with payoff matrix 



C (ooperation) 

D (efection) 

c 

( 1 , 1 ) 

(-3,3) 

D 

(3,-3) 

(- 1 ,- 1 ) 
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Let the conditional influence be symmetric, so it goes down to just two variables x 
and y. 


x = P L |a(si = C | = D, ^ =C)=x 

y = Pl\a(si = C | ^ = C, a™ =C) = y 

The complete payoff matrix has been calculated in |Krausllj . 

Depending on x and y the hierarchical game T is isomorphic to one of the following 
games with unique Nash equilibrium a and the tipping points for these three states 
are x = and x = 



Figure 3: Illustration of the situation of T depending on x and y 


1 . r is a prisoner’s dilemma where 

for Ai : (C, C ) ~ Cooperation, ( D , C) ~ Defection 

for A 2 : (C, C) ~ Cooperation, ( C,D) ~ Defection 

That means, Ai identifies with 1 and A 2 identifies with 2. 

Hence the unique Nash equilibrium is a = (ctah dA 2 ) = ((-D, C), (C, D)). 

2 . T is a prisoner’s dilemma where 

for Ai : (C, C) — Cooperation, (C, D) ~ Defection 

for A 2 : (C, C ) ~ Cooperation, (D, C ) ~ Defection 

That means, Ai identifies with 2 and A 2 identifies with 1. 

Hence the unique Nash equilibrium is a = ((C, D), (D, (7)). 

3. Cooperation: 

For Ai and A 2 , the strategy (C, C) dominates every other strategy and there¬ 
fore a = ((C, C), (C, C)). 
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Because of the symmetry the payoffs of Ai and A 2 coincide: v//(a) = 

Hence the value of the game, i.e. the payoff in the Nash equilibrium a, is as follows: 


{ —1 + 2x x <^ 

-1 + 2 y ^<x<*±± 
l-2x X > 

Remark 13. In the 1-dimensional hierarchy considered in section \).2 \ we had 

V{~,a) ■ M+, c ) 

X —— - 

h(~, a) ■ n(+, c) + n(+, a) • //(-, c) 

= _ M(++) ' h(+,c) _ 

M(+,«) ' M+, c) + M(-,«) ' M(-> c) 

where p{±,k) = cosh fc_1 (/3) cosh(^) ± sinh fc-1 (/3) sinh(^) and the inverse tempera¬ 
ture (3 = Ttai depended on the random minority voters. 


Hence in the one-dimensional hierarchy we get the tipping points above, but x and 
y are still smooth functions in /3. On the contrary, for a two-dimensional hierarchy, 
x and y would exhibit proper non-analytical phase transitions in the thermodynamic 
limit, turning the tipping points into proper phase transitions. 


5 Open Questions 

Question 14. If we choose the Shapely value as payoff mechanism as above, the 
overall transformed game T depends only on the game G and the correlators. What 
can be said in general about the game theory of T compared to G without explicit 
knowledge of the correlators (under some reasonable, general assumptions)? 

Question 15. It would be interesting to derive closed expressions for the correlators 
of an Ising model on a locally treelike random graph, similarly to the partition 
functions obtained in this case in WCHlff) ; it is to be expected that e.g. the 2-point 
correlator depends only on the distance. This would yield a very nice explicitly 
solvable model with phase transition for games on randomly dependent agents. 

Question 16. Our model does not necessarily require the graph to be a directed 
tree, see end of section 2.1. In fact, mutual dependencies might be more realistic. 
Then the following issues arise: 

• Even in the easiest case, the partition sum does (to our surprise) not coincide 
with the partition sum of the Ising model. Rather, there are corrections for 
every directed loop. It would be nice to explain this behaviour and/or derive 
expressions for the partition sum, phase transition etc. in this modified ver¬ 
sions using the same techniques from statistical physics as for the Ising model 
(transfer matrix for small dimension, mean field method for large dimension 
resp. branching number). 
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• Alternatively, one might introduce a relaxation time, so the model gains a time 
dependence. This could be interesting to study non-stationary behaviour. 


Question 17. Can there be obtained statistical real-world evidence (and quantified), 
that the existence of inter-dependency on the path between deciding players and 
actual decision (as modelled in this article) increases cooperation? 
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